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OK THE SOLUTION OF LINEAR EQUATIONS IN INFINITELY MANY VARIABLES. 
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1. HISTORICAL IKTRODUCTION. 

In this thesis we shall consider systeics of equations, of the 
general type 



(0 



where the A;; and Cj, are given real^ constants and the X; are to 
be determined. 

The first person to treat successfully such a system was 
Fourier, who in 1S22 was led to a systecr- of type (1) by attempting 
to obtain a solution of a certain differential equation in the 
form of a trigonomertic series. Fourier considered the auxil- 
iary systeiD 






which has the solution 

In his numerical case, he found that the liicits 

actually furnished a solution of his original system (1). 
Fourier proved nothing about the general validity of this method 
for solving systems of the type (I);- he was primarily interested 
in finding a solution for his own numerical case. 



^In fact, the whole dieoueeion holds alaoet verbatia for 
complex numbers also. 



Digitized by 



Google 



Digitized by 



Google 



A method somewhat similar to that of Fourier was used by 
G.W.Hill* in 1877. Like Fourier, he was led to system* (1) 
while trying to solve a certain differential equation by means 
of a trigonomei^ic series. Instead of considering the auxil- 
iary systems (2) and the corresponding determinants. Hill 
considered directly the infinite determinant 



A = 
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1 i 


All ^^y 
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Hill manipulated this determinant- ajdefinite numerical expression 
in his case - precisely as one ordinarily manipulates a finite 
determinant. Like Fourier, he was simply interested in a 
numerical case and hence did not consider the general legiti- 
macy of thus operating with infinite deterirdnants. In fact. 
Hill did not even justify his own numerical results. But a 
few years later, in 1865, Poincare'^took up the general study 
of infinite determinants and their use to solve systems of 
type (1). Poincare'' showed that the formal work of Hill was 
justified. Later we shall consider more in detail the results 
of Poincare^as Extended by von Koch. 

Historically, then, operations with infinite determinants 
proved useful and valid in the first cases where they were 
performed. This immediately raises the question whether such 
operations are always valid - in particular, whether the method 
of Fourier will always lead to a solution of the system (1). 
We turn first to the answer of this question. 



*"0n the part of the notion of the lunar perigee whioh is 
a funotion of the mean motions of the sun and noon", Aota_ 
Mathe matioa, t«8. 

^Hill oonsidered his systen in a slightly different form, 
but it oan be readily put into the form ( 1) • 
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2.C0KTRAST WITH FINITE SYSTEMS ^ Kumerical Dcamples. 

There are three principal properties of systems of n^ linear 
equations in n^ unknowns, when the determinant of the system is 
not zero: 

a) there is always one solution, 

b) there is only one solution, 

c) this solution can always be found by the use of determinants. 
It will be shown, by examples, that none of these properties is 
invariably true for infinite systems of type (1) with non-vanishing 
determinant. For simplicity, consider systems (1) such that A;.c = 1 
for every L, and Ac,-0 for every t>j,. The determinants of 

these systems are unity, as are the determinants of the auxiliary 
systems (2) which are used in applying the method of Fourier. 
a)From the system 



A, + \3,-^A3 T ^ ^ 






N5+- "i 



it follows by subtracting the (k+l)-th equation from the k-th 
equation that if there is a solution it must be 

When we substitute these values in the left hand members of our 
equations, we obtain series which diverge. However, if we use 
the word "solution" to include a set of values for which the 
series in the left hand members of the original equations do not 
converge but are suiTimable to the corresponding right hand members, 
then the above values are a solution. 

A formal solution may lead even to convergent series, 
whose sums are different from the corresponding right hand 
members of the original equations. For example, the system 



Digitized by 



Google 



Digitized by 



Google 



has the formal solution Xk=C for every k . For these values, 
the series converge, but we have an actual solution when and 
only when wv. - o^ 

Also, a formal solution may make the left hand members 
diverge with infinite sum, as in the system 

The formal solution is \j^--I , but for these values the corresponding 
series diverge with infinite sum. 

b) There exist systems with non-vanishing determinant 
which have an infinite number of solutions. For example, the system 
X» -A^ =: ^ 

^3 *" ^s- C O 



has not only the evident solution X^-o ,but also the solution 
)^^-n. for every k , whatever the value ofK. 

c) There exist systems withtion-vanishing determinant which 
have an infinite number of solutions, and yet no solution can b e 
found by the determinantal method of Fourier. For consider the 
system 

The auxiliary systems^of Fourier have the solutions 

X'; -- 1 , 



Kt-i, v.'-!, x7-J. 
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* (vv.) I 

It follows that \aa^ Xu^^^for every K • But clearly the system 

has an infinite number of solutions, since ^, may be chosen arbitrarily. 

These illustrations show, then, that the method of deter- 
minants is not always applicable. However, if the Ail and the d 
of system (1) are suitably restricted, the method is applicable. 
A general application of this method was first developed by 
Poincare" and was later extended by von Koch. 
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3. STATEMENT OF THE RESULTS OF VON KOCH J 
Consider the system 






u; 
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Pm Aw,^ M^^k I Ck AwKi« A>vk| 



^There 1b a bibliography at the end of this thesis. 
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this limit also must exist. Under the restrictions indicated, 
von Koch establishes the following results: 

THEOREM la. If A^O, X^^ ^ is_a solution of (1); the K^ 
are limited, and this is the only solution for which the. X^ 
are limit ei. 

THEOREM lb. If i^^o , the homogeneous system corresponding to (1) 
always , has a solution oth e r than the ev ident solution X^^^C . The 
sy stem (1) itself has_eith er no soluti oiLjin which_case equations 
(1) are incon si stent ] or has an infinite number ofsolutions. * 

The use of infinite determinants is by no means the only 
method of solving equations of type (1). Next I shall use a direct 
method of successive approximations - a method similar to the 
Picard approximation process which is well known in connection 
with the theory of differential equations^. So far as I am 
aware, this method has never been previously applied - in either 
theory or practice - to solve systems of type (1).® The theory as 
developed below gives not only a nurcber of new theoreiEs, but also 
includes THEOREM! la of von Koch. Moreover, the method of 
successive approximations is not only useful for the theory as 
developed below; it is a practical method for numerical computation. 



^If the Bystett ( l) has sore than one solution, the dlfferenoe 
of any two Bolutione ia a aolution of the oorreaponding honogenoous 
ayatott. Any aultiple of the last solution ia alao a aolution of 
the hottogeneous aystett. Henoe, the original ayatea haa an 
infinite nunbar of aoluti^na. 

^6ee alao the aeoond footnote below. 

®ilee, however^ the Appendix* 
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4.METH0D OF SUCCESSIVE APPROXIMATIONS. 

It will be convenient tojwrite our equations in the form 



The following theorem will now be established:. 
THEOREM II. Under the restrictions 

the system (3) has always^ j)ne so l ution and only one solution 
such th at the Xl are bounded^ 

For successive approximations^place^ 




>. 



^The Method 1b analogous to, and waa auggeated by the Pioard 
prooeaa. See Laleaoo, Theorie d e a E^oat i o n a I n t^e g r al e a > p. 7. 

*Any other bounded aet would aerre for the flrat aet of 
approxittationa* 
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It follows that we can set 

{!) A, = Ki t uf -A":' ) ^ e^ « -At) t - , 

since the series on the right converges. 

The Ay^, as thus defined, are a solution of equations (3), For 

adding equations (5), on the right we have a double series that is 
absolutely convergent. When we sum tbff ■■»». the double series 
by columns, we find 

so the X|c are a solution of (S). 

It follows from equations (6) and (7) that 

and therefore the ^^ ^^e limited. It will next be shown that 
there is only one solution of (3) for which this is true. If Xk 
and Xji denote two such solutions of (3), then Xh^X^-xJ^ is limited, 
and X,^ is a solution of the homogeneous system corresponding to (3): 

Carry through the approximation process for this system:. 
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Hence X^*^ , and therefore the two solutions \^ and X^ are identical, 
which we were to prove. 

It should be noticed that if we omit from the hypothesis 
the restriction P^i or even if we allow f^| , the theorem would 
be untrue. In fact, it is possible to have in this case 

a) no solution of the system. This is apparent from the 
inconsistent system 

X,t\, X C, ^ 






1 



J 



X, - c, ^ 



b) an infinite number of solutions such that the X^ are 
bounded;- this is illustrated by the system 

c) an infinite number of solutions, but no solution for which 
the An are bounded. This is obviously true of the system 
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However, the fact that the theorem is not true for f-J^ does not 
mean that the conclusion necessarily fails nor that the approximation 
process can never be used in this case. For although we cannot use the 
approximation process in a) and c) as in both cases the series 
for K^ diverge^ with infinite sum for at least one value of K ,we 
can use the process to solve the system 

Though the series 

all diverge, they are summable to the values X|^= I , and this set 
of values actually is a solution - indeed the only solution - 
of the original systei. 

It is seen, then, that for a general theorem some such 
restriction as Pt 1 is necessary. However, by specializing the 
form of the equations, this restriction can be lightened to 
a certain extent. This is done in 
THEOREM III. If the systeir 



s atisfies the hypotheses 



} 



-i-^\ 



CJ>>wc*^i,,-.~A 
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X) 



L 



-ttl 



(7 
tbenj tbe system (10) has^oDe_splution and only on e_solutioD for 

wbicb,the X^^ are bounded , 

Tbis tbeorem can be proved by using the approximation 
process used in tbe proof of THEOREM II.* The two proofs are so 
much alike«that we omit the proof of THEORKW III. 

THEOREMS II and III surely include cases not included in 
THEOREM la of von Koch. For example^ in (10) take 

Tbe series. ^!~j^vl diverges. On the other hand^ we shall show 
later that'THliCREiV la can be included in THEORE.V III. The 
ffiethod of proof is to start with the system (1)^ transform into 
tbe type (10), and to show that the transformed system satisfies 
tbe hypotheses of THEOREV HI. It so frequently occurs that 
equations need to be transformed into the form (10) that it is 
worth while to devote a section to this transformation. 



*0r, we oan omit tbe first N equations snd apply THEOREM II 
to the remainder* Then to find the first N unknowns we have 
merely to solve a system of N equations in N unknowns; the 
determinant of this finite system does not vanish. 

^Perhaps the easiest way to prove THEOREM III by using the 
approximation process is to notice the truth of the theorem 
for N «• 0, and then to demonstrate it for N » 1, 2, •••, 
thus making a proof by induction. 
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5.TKAi\SFCRMATI0N CF SYSTIiMS INTO SPS..CIAL FORy. 

A very large class of systems of equations of the general type 






can be transformed into equivalent systems of the special form 

/ 
( 

L 



00 



Aj-t- 









Roughlyspeaking, to effect this transforiration we leave unchanged 
the first equation of (1); use this first equation to eliiiinate 

X, from the second equation; use the first and second equations 
to eliminate X| and S^. froiE the third equation, and so on. This 
leads to the system 

which is readily put into the form (11). 

To be more explicit, this transforfLation from (1) to (12) 
can always be acco'iiplished if we suppose 

All Ai^ A» 

^ 0, (k-^^.i, } 



A - 



Ak» Anv A*M 

For in this case we have a.erely to place^ 



^See Riesa, Lee SyeVemea d'Ejuations Lin/airea a un« infinite^ 
d*lnoonnuaa, p*ll« 
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(13) 



A.A.x A,^,A 



IK I 



V 






» I 



Presently it will be shown that the transforaiation from (1) 
to (12) [and hence to (11)] can be made if there exists an N 
such that A'^'^O for w^H . for this purpose we need the 
LilvMA, IjLany_jipn-vanishing_ determinant^ 

^k;^ ^u^^^ ' A IK 

Aki Aki Akr 
the rows can be arranged so tnat no minor ©i ci:j icr: 



A"- 



AfiA,^ Alt 

A>| A;ia - ' AaL 

Alt Ai.> Ati 



(c.i.a, >^ 



will_vanij[il> 

Surely Ati^O for some value of l ; otherwise we should have 
^-C. Hence by a change (if necessary) in the order of the rows, 
we can make A^^C . Let us suppose that d'^^ ku \ Oj C^^i^Cj 
A^-^O^t^^^^^o , and that by no further change in the order of the 
rows succeeding the Y\.-th can we make A -i^O . Then each of the 
sets of constants 



A»K..M, ^w. = Kt^,Kt:^,- X) 



is linearly dependent on the sets of constants 
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Hence we can write A in the form 

Ah Aia A) IV+-I A| Atx 

All An Ai Kti Ai>.> 
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A, 



IK 






Am Avi 








I 



Ak^k+i A*vk+ 
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V\ti,w^* 
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K+X K«-» 



n 



K. 



i\i> 



Aw !, 



I 1 



K 



l<H 



(K^.»t^O 



J*^) 



Therefore A ■=^ , contrary to our hypothesis. This completes 



the proof of the iemma. 



AXl 



If the system (1) , then, is such that there exists N so that 
t!^\o whenever A^N, the first H equations can be arranged to 
make /V"^^ for k -i,>^ H . This rearrangement does not change 
the values of A^^ for w>N . Hence we can arrange the equations 
so that Z5^^^0 for every value of w . 

In particular, if we are dealing with the infinite deter- 
minant which appears in TKEOREk la, A'^C , it is surely true 
that there exists N such tc\atJI^\o for k^N , and hence the 
equations can be arranged so that A. ^0 for every vt . 



Digitized by 



Google 



Digitized by 



Google 



n 



6. PROOF OF SOME RESULTS OF VON KOCH. 
Let us consider the system 






^ /_^ 111 0'>^^^r«^vJ ' 



l/^ 



^ 



?fe shall consider only the case treated in TKIiOSEy la, naflnely, 
that in which Z^ X • Further, it will be supposed that 
the equations have been arranged so that ^^^ ^ (^vi^ \ a^ j^ 
Rearrangement of any system (1) to satisfy this last restriction 
would not disturb the convergence of the double series or 
infinite product. 

Replace system (1) by an equivalent system of type (12), 
using formulas (IS), If we set 



A.H'~M+nM , 






h\\ At*. Ai*v-i C , 



k-hM. 
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For to every term on the left there corresponds a positive term 
on the right which is not smaller than that term. Hence thefiy^^ 
are limited. 

Next we shall prove that the series of coefficients in the 
i-th row of (12) converges absolutely, and that the sum* of the 
absolute values of the terms can be made as small as desired 
for every L7I , where I is properly chosen. From (13), 
using the method used in (14), we see that for y\-<K^ 

Therefore 



lkJtT>.-MM+ ^|A 



^|L>-t^ 



^-ir- iK.K..h 1 ^^.- 



+ mn,H 



^ /^K,»-H 






l\^^^|^K,wJ, 



IThen for every value of n, the series ^ converges. From the 
convergence of o«o 



z 1 A^a 






V 



'^ 



Digitized by 



Google 



Digitized by 



Google 



rf 



it follows that B;i can be made arbitrarily small simply by 
taking n > N ^ where ^is properly chosen* 

Then we have transformed the system (1) into a system (12)^ 
such that the U are limited, the series of the absolute 
values of the coefficients in the n^-th row converges for every 
D, and its sum can be made as small as desired by taking n>JI, 
None of the -(r,^^ is zero; for rv c>> they approach a limit 
different from zero. It follows ttjat when system (12) is put 
into the form (11) that the hypotheses of THEOREM III are satisfied. 
Hence system (1), under the hypotheses given, has been transformed 
so as to be included in THEOREM III. Thereby has been proved 
the existential part of von Koch's THEORtV; la. 
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7. FURTHER RESULTS- USING SUCCESSIVE APPROXIMATIONS. 

We shall now restrict ourselves to equations of the form^ 
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When this thesis was almost completely written, it was 
found that THEOREM II had been previously proved by von Koch, 
Jahresbericht, 1913, p. 2S9. He used essentially the same method 
of sucessive approximation used in this thesis. However, he 
seems to have used this method to prove none of the other theorems 
proved in this thesis. THEOREMS III, IV, V, VI, and VII are new. 

A comparison of the various methods of solving linear 
equations in infinitely many variables as well as some numerical 
examples are given by E. Goldschmidt, Wurzburg Dissertation, 1912. 
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